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VERIFIED STATEMENT CLAIMING SMALL ENTITY STATUS 
(37 CFR 1.9(f) & 1 .27(b))— INDEPENDENT INVENTOR 



PTO/SB/09 (1 1.90) 



Docket Number (Optional) 



Applicant or Patentee: 
Serial or Patent No.: 

Filed or Issued: 

Title: 



John B. Ferber and Scott Ferber 
Not assigned 



Herewith 



Optimal Internet Ad Placement 



As a below named inventor, I hereby declare that I qualify as an independent inventor as defined in 37 CFR 1 .9(c) for purposes 
of paying reduced fees to the Patent and Trademark Office described in: 

S the specification filed herewith with title as listed above. 

□ the application identified above. 

□ the patent identified above. 

I have not assigned, granted, conveyed or licensed and am under no obligation under convey or law to assign, grant, convey or 
license, any rights in the invention to any person who would not qualify as an independent inventor under 37 CFR 19(c) if that 
had made the invention, or to any concern which would not qualify as a business concern under 37 CFR 1 9(d) or a nonprofit 
organization under 37 CFR 1.9(c). 

Each person, concern or organization to which I have assigned, granted, conveyed, or licensed or am under an obligation under 
contract or law to assign, grant, convey, or license any rights in the invention is listed below: 

O No such person, concern, or organization exists. 
EZ3 Each such person, concern or organization is listed below. 
Advertising.com 



Separate verified statements are required from each named person, concern or organization having rights to the invention 
averring to their status as small entities. (37 CFR 1,27) 

I acknowledge the duty to file in this application or patent, notification of any change in status resulting in loss of entitlement to 
small entity status prior to paying, or at the time of paying, the earliest of the issue fee or any maintenance fee due after the date 
on which status as a small entity is no longer appropriate.^ 7 CFR 128(b)) 

I hereby declare that all statements made herein of my own knowledge are true and that all statements made an information and 
belief are believed to be true, and further that these statements were made with the knowledge that willful false statements and 
the like so made are punishable by fine or imprisonment, or both, under section 1001 of Title 1$ of the United States Code, and 
that such willful false statements may jeopardize the validity of the application, any patent issuing thereon, or any patent to 
which this verified statement is directed. 
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VERIFIED STATEMENT CLAIMING SMALL ENTITY STATUS 
(37 CFR 1.9(f) & l»27(c))-SMALL BUSINESS CONCERN 



Docket Number (Optional) 



Applicant or Patentee: John B. Ferfrer and Scott , Ferber 
Serial or Patent No.: Not assigned 

Filed or Issued: _ Herewith 

Title: Optimal Internet Ad Placement 

I hereby declare that J am 

D the owner of thee small business concern identified below; 

J3.an official of the small business concern empowered to act on behalf of the concern identified below; 
NAME OF SMALL BUSINESS CONCERN Advertising . com 

ADDRESS OF SMALL BUSINESS CONCERN 1010 Hul1 Street, The Tide Building, 

2nd Floor, Baltimore, Md. 21230 
I hereby declare that the above identified small business concern qualifies as a small business concern as defined in 13 CFR 
1 2 1.12, and reproduced in 37 CFR 1.9(d), for purposes of paying reduced fees to the United States Patent and Trademark Office, in 
that the number of employees of the concern, including those of its affiliates, does not exceed 500 persons. For purposes of this 
statement, (I) the number of employees of the business concern is the average over the previous fiscal year of the concern of the 
persons employed on a full-time, part-time or temporary basis during each of the pay periods of the fiscal year, and (2) concerns are 
affiliates of each other vvhen either, directly or indirectly, one concern controls or has the power to control the other, or a third party or 

parties controls or has the power to control both. 

I hereby declare that rights under contract or law have been conveyed to and remain with the small business concern identified 
above with regard to the invention described in: 



JP the specification filed herewith with title as listed above. 

the application identified above. 
^0 the patent identified above 

jU If the rights held by the above identified small business concern are not exclusive, each individual, concern or organization 
^having rights w the invention must file separate verified statements averring to their status as small entities, and no rights to the 
iiivention are held by any person, other than the inventor, who would not qualify as an independent inventor under 37 CFR 1 .9(c) if 
; t^at person made the invention, or by any concern which would not qualify as a small business concern under 37 CFR 1 .9(d), or a 
"nonprofit organization under 37 CFR L9(e). 

Each person, concern, or organization having any rights in the invention is listed below; 

[2 no such person, concern or organization exists. 

each such person, concern or organization is listed below, 

I * Separate verified statements are required from each named person, concern or organization having rights to the invention 
awning to their status as small entities. (37 CFR 1 .27). 

I acknowledge the duty to file, in this application or patent, notification of any change in status resulting in loss of entitlements to 
small entity status prior to paying, or at the time of paying, the earliest of the issue fee or any mamtenance fee due after the date on 
which status as a small entity is no longer appropriate (37 CFR 1.289(b)) 

I hereby declare that all statements made herein of my own knowledge are true and that all statements made on information and 
belief are believed to be true; and further that these statements were made with the knowledge that willful false statements and the like 
so made are punishable by fine or imprisonment, or both, under section 1001 of Title 18 of the United States Code, and that such 
willful false statements may jeopardise the validity of the application, any patent issuing thereon, or any patent to which this verified 
statement is directed. 

* NAME OF PERSON SIGNIN G Thomas McMahon 
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Title: Optimal Internet Ad Placement 

Inventors: John B. Ferber and Scott Ferber 

1 RELATIONSHIP TO PRIOR APPLICATIONS 

2 This application claims the benefit of U.S Provisional Application No. 

3 60/164,253, titled "Optimal Internet Ad Placement Technology," filed November 8, 1999. 
4 

5 BACKGROUND OF THE INVENTION 

6 This invention relates generally to the allocation (e.g. as in a market or exchange) 

7 of the supply of a class of products / services with the demand for a class of products / 

8 services in an optimal manner (i.e. system- wide best solution since the values of different 

9 allocation strategies may vary significantly) that quantifies and accounts for the 

10 uncertainty surrounding the supply and demand of different products / services. More 

1 1 particularly, the present invention comprises a system and method for the optimal 

12 placement of ads on Web pages. 

13 Optimal ad placement has become a critical competitive advantage in the Internet 

14 advertising business. Consumers are spending an ever-increasing amount of time online 

1 5 looking for information. The information, provided by Internet content providers, is 

16 viewed on a page-by-page basis. Each page can contain written and graphical 

17 information as well as one or more ads. Key advantages of the Internet, relative to other 

1 8 information media, are that each page can be customized to fit a customer profile and ads 

19 can contain links to other Internet pages. Thus, ads can be directly targeted at different 
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1 customer segments and the ads themselves are direct connections to well-designed 

2 Internet pages. Although the present example has been described with respect to 

3 traditional Web browsing on a Web page, the same principals apply for any content, 

4 including information or messages, as well as advertisements, delivered over any Internet 

5 enabled distribution channel, such as via e-mail, wireless devices (including, but not 

6 limited to phones, pagers, PDAs, desktop displays, and digital billboards), or other media, 

7 such as ATM terminals. 

8 Therefore, as used herein, the term "ad" is also meant to include any content, 

9 including information or messages, as well as advertisements, such as, but not limited to, 

10 Web banners, product offerings, special non-commercial or commercial messages, or any 

1 1 other sort of displayed or audio information. 

1 2 The terms "Web page," "Web site," and "site" are meant to include any sort of 

13 information display or presentation over an Internet enabled distribution channel that may 

14 have customizable areas (including the entire area) and may be visual, audio, or both. 

1 5 They may be segmented and or customized by factors such as time and location. The term 

1 6 "Internet browser" is any means that decodes and displays the above-defined Web pages 

1 7 or sites, whether by software, hardware, or utility, including diverse means not typically 

1 8 considered as a browser, such as games. 

19 The term "Internet" is meant to include all TCP/IP based communication 

20 channels, without limitation to any particular communication protocol or channel, 

21 including, but not limited to, e-mail, News via NNTP, and the WWW via HTTP and 

22 WAP (using, e.g., HTML, DHTML, XHTML, XML, SGML, VRML, ASP, CGI, CSS, 
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1 SSI, Flash, Java, JavsScript, Perl, Python, Rexx, SMIL, Tel, VBScript, HDML, WML, 

2 WMLScript, etc.). 

3 The term "customer" or "user" refers to any consumer, viewer, or visitor of the 

4 above-defined Web pages or sites and can also refer to the aggregation of individual 

5 customers into certain groupings. "Clicks" and "click-thru-rate" or "CTR" refers to any 

6 sort of definable, trackable, and/or measurable action or response that can occur via the 

7 Internet and can include any desired action or reasonable measure of performance activity 

8 by the customer, including, but not limited to, mouse clicks, impressions delivered, sales 

9 generated, and conversions from visitors to buyers. Additionally, references to customers 

10 "viewing" ads is meant to include any presentation, whether visual, aural, or a 

1 1 combination thereof. 

12 The term "revenue" refers to any meaningful measure of value, including, but not 

1 3 limited to, revenue, profits, expenses, customer lifetime value, and net present value 

14 (NPV). 

1 5 The Internet ad placement technology of the present invention provides an optimal 

1 6 strategic framework for selecting which ad a customer will view next. It maximizes the 

1 7 overall expected ad placement revenue (or any other measure of value), trading off the 

18 desire for learning with revenue generation. The technology can be executed in "real- 

1 9 time" and updates the strategy space for every customer. 

20 At its core, the problem is to place the right ad to the right customer. Ad 

21 placements are compensated based on the number of successful responses that they 

22 generate. This usually means that compensation occurs every time a customer responds 
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1 to (e.g., clicks) an ad. Customers respond to ads according to their interests and demands. 

2 Thus, a key necessity is to obtain a reliable characteristic profile of each customer. Only 

3 with given information about the customer can ads be provided that are targeted towards 

4 each customer. Second, there is a need to estimate how different customers will react to 

5 different ads. That is, a customer-ad response relation is required. Finally, there is a need 

6 for an ad placement technology that optimally decides which ad to show. At the instant a 

7 customer opens a page, it is necessary to place an ad. The ad placement technology must 

8 incorporate the customer's likely response to each ad and the financial gains resulting 

9 from a customer's selection of an ad. 

10 A successful ad placement technology must overcome several critical 

1 1 complications. First, the ad placement algorithm must be sufficiently fast to ensure "real- 

12 time" placement. Second, a key element of the technology is its ability to learn through 

13 continuous updating. Little information is available about new ads. However, as ads are 

14 placed, it can be learned how they relate to various customer profiles. Thus, the 

1 5 technology should both be able to learn and trade off learning versus revenue generation. 

1 6 Finally, the ad placement technology must be able to detect ineffective ads and 

1 7 incorporate minimum and maximum ad placement and ad selection constraints. 

18 

1 9 BRIEF SUMMARY OF THE INVENTION 

20 This invention concerns optimal ad selection for Internet-delivered ads, such as 

21 for Web pages, by selecting and updating an attribute set, obtaining and updating an ad- 

22 attribute profile, and optimally choosing the next ad. The present invention associates a 

4 



1 set of attributes with each customer. The attributes reflect the customers' interests and 

2 they incorporate the characteristics that impact ad selection. Similarly, the present 

3 invention associates with each ad an ad-attribute profile in order to calculate a customer's 

4 estimated ad selection probability and measure the uncertainty in that estimate. An ad 

5 selection algorithm optimally selects which ad to show based on the click probability 

6 estimates and the uncertainties regarding these estimates. 

7 It is therefore an object of the present invention to integrate the optimization and 

8 scheduling of web-based ad serving. 

9 It is another object of the present invention to provide an optimal strategic 

1 0 framework for selecting which ad a customer will view next. 

11 It is also an object of the present invention to maximize the overall expected ad 

1 2 placement revenue (or any other measure of value), trading off the desire for learning 

1 3 with revenue generation. 

14 It is another object of the present invention to place ads on Web sites in such a 

15 way as to maximize the overall value for the ad serving entity, whether based on 

16 impressions, clicks, conversions, or combinations thereof. 

17 It is an object of the present invention to provide an ad placement algorithm that is 

1 8 sufficiently fast to ensure "real-time" ad placement. 

19 It is an object of the present invention to provide an ad placement technology that 

20 has the ability to learn through continuous updating. 

21 It is another object of the present invention to provide an ad placement technology 
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1 that is able to detect ineffective ads and incorporate minimum and maximum ad 

2 placement and ad selection constraints. 

3 It is an object of the present invention to provide an estimate of the probability a 

4 customer will click an ad by estimating a principal component vector as well as the ad's 

5 click probabilities. 

6 It is yet another object of the present invention to provide binomial updating of 

7 click probabilities using principal components, as well as category restrictions and ad 

8 blocking. 

9 It is yet another object of the present invention to provide automatic clustering of 

1 0 Web pages in a manner that effectively improves overall Click-Thru-Rates. 

11 It is another object of the present invention to provide optimal delivery of content, 

12 messages, and/or ads to customers by any Internet enabled distribution channel. 

13 It is a final object of the present invention to optimize ad placement across a 

14 diverse set of media, such as banners, e-mail, and wireless, in an integrated manner via an 

15 allocator. 

1 6 These and other objectives of the present invention will become apparent from a 

1 7 review of the detailed description that follows. 

18 
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1 BRIEF DESCRIPTION OF THE DRAWINGS 

2 Figure 1 illustrates the possible use of the present invention in a prior art direct 

3 marketing system. 

4 Figure 2 illustrates a first embodiment of the present invention for brand name 

5 and mass appeal products. 

6 Figure 3 illustrates a second embodiment of the present invention for lots and 

7 niche products. 

8 Figure 4 illustrates a schematic of the present invention. 

9 Figure 5 illustrates the Integrated Channel Management system of the present 

1 0 invention. 

1 1 Figure 6 illustrates a schematic of the system of the present invention. 

12 Figure 7 illustrates a schematic of the process of the present invention. 

13 Figure 8 illustrates a matching of supply and demand for advertising on Internet 

1 4 enabled distribution channels. 

15 

1 6 DETAILED DESCRIPTION OF THE INVENTION 

1 7 The present invention comprises a system and method of optimal ad placement. 

1 8 This invention divides the optimal ad selection problem into three parts: (1) how to select 

19 and update the attribute^ set, (2) how to obtain and update the ad-attribute profile, and (3) 

20 how to optimally choose the next ad. For purposes of this description, the application of 
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1 the present invention will be illustrated with respect to reconciling the supply of Web 

2 pages with the demand for ads on those Web pages in an optimal manner that maximizes 

3 revenue. It is assumed that each Web page can only promote one ad at a time, although 

4 that is not a limitation of the present invention. Furthermore, the ad provider pays on a 

5 per click (ad selection) basis. A typical employment of the invention is illustrated in 

6 figure 1, wherein customer and client (ad) data 110 is input, turned into information 120 

7 for modeling and used for ad serving 130, as illustrated in figure 8. 

8 The present invention associates a set of attributes with each customer. The 

9 attributes reflect the customers' interests and they incorporate the characteristics that 

1 0 impact ad selection. 

1 1 Similarly, the present invention associates with each ad an ad-attribute profile. 

12 The ad-attribute profile has two uses, to calculate a customer's estimated ad selection 

13 probability, and to measure the uncertainty in that estimate. 

14 The ad selection algorithm optimally selects which ad to show based on the click 

1 5 probability estimates and the uncertainties regarding these estimates. That is, it optimally 

1 6 trades off current revenue potential with future revenue potential represented by the 

1 7 uncertainty surrounding these estimates. Ads that have been frequently placed will have a 

1 8 well-documented current revenue potential while new ads with few placements represent 

1 9 the possibility of high future potential. 

20 As customers have long-term interests as well as short-term demands the present 

4 f 

21 invention divides attributes into a long-term and a short-term attribute sets. The long- 

22 term attribute set measures how much time customers spend in different interest 
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1 categories such as business, sports, and health. The short-term attributes detect when a 

2 customer is searching for specific products. 

3 Long-term attributes 

4 Long-term customer attributes in the present invention are updated, depending on 

5 time and network constraints, on a placement-by-placement or on a time period-by-time 

6 period (for example day-by-day) basis. The attributes measure, for example, how much 

7 time on a percentage basis a customer spends in each interest group (i.e., sports, 

8 gardening, etc.). Thus, suppose that the customer chooses sports half the time and 

9 finance half the time. Then sports and finance attributes are each 50% and the remaining 

10 attributes are 0%. 

1 1 Customer interests also change. To accommodate this factor the present invention 

12 implements either a moving average or an exponentially-weighted approach to updating 

1 3 each customer's long term attributes. Both of these statistical methods put more 

14 emphasis on recent information and can be updated easily. 

1 5 The attributes together cover all the distinctive characteristics of the customers. 

16 There are two ways the attributes are structured. The present invention has a common set 

1 7 of attributes that are always updated. Alternatively, the present invention has two sets of 

1 8 attributes, a base set given by easily available data, and a second set of attributes that are 

19 revealed as the customer carries out certain actions. 

20 Short-term attributes 

# t 

21 The short-term attribute set of the present invention signals every time there is a 

22 specific interest for a particular service or product. For example, suppose a customer is 
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1 currently shopping for a computer. Such an event can be detected by specifically marking 

2 sites that perform computer comparison tests. The probability that the customer selects a 

3 computer ad will be high. 

4 Ad-attribute profiles 

5 Customers also respond differently to different ads. The ad-attribute profile of the 

6 present invention measures how sensitive the ad is to the various attributes and thus how 

7 likely it is that a customer will react when shown an ad. As the profile for a given 

8 customer is not known ahead of time, it must be estimated. This profile estimation 

9 algorithm provides an efficient means for updating the attribute estimates in "real time." 

10 It is not necessary to store the complete history of customers* responses, but only a set of 

1 1 sufficient statistics for each ad. The sufficient statistics are one square matrix variable 

12 with dimension equal to the number of attributes, one vector variable with dimension 

13 equal to the number of attributes, and two scalars. Furthermore, the sufficient statistics 

14 can be quickly calculated. 

1 5 The profile estimation algorithm also records the uncertainty of each ad-attribute. 

16 The uncertainty conceals an ad's effectiveness (as measured by the true click probability). 

17 As an ad's effectiveness directly drives the revenue generation it is important to quickly 

1 8 derive a good estimate. The uncertainty regarding an ad's effectiveness decreases as the 

1 9 number of times it is shown increases. 

20 Optimal Selection 
« * 

21 The ad selector of the present invention places ads in a way that maximizes the 

22 expected overall long-term ad placement revenue (or any other measure of value). The ad 

10 



1 placement revenue is the compensation received every time an ad is clicked. For the 

2 moment, suppose that it is known with certainty the ad-attribute profile for each ad. This 

3 means that the probabilities that the customer will react to the ads can be calculated. 

4 Multiplying the probabilities with the compensations of the corresponding ads yield the 

5 expected ad placement revenues for all ads. The choice that maximizes the expected 

6 overall ad placement revenue is then simply the ad with the highest expected ad 

7 placement revenue (or any other measure of value). 

8 Unfortunately, one does not know with certainty the ad attribute profiles. This 

9 means that the above selection algorithm, if employed using the estimated ad-attribute 

10 profile, would not correctly account for revenue generation opportunities of those ads that 

1 1 have not been shown, because it would not incorporate the huge estimation uncertainty of 

12 those ads. 

13 This ad-placement algorithm incorporates the uncertainty as well as the expected 

14 ad revenue in the selection criterion. Conceptually, the uncertainty is a reflection of the 

15 ad's potential upside. That is, it is more likely that the probability of an ad with high 

1 6 uncertainty is significantly higher than its' estimated value than an ad with low 

1 7 uncertainty. Only by testing can the present invention determine whether it is actually 

1 8 true. If true it is clear that there is much to gain in the future. 

1 9 The ad-placement selection rule works by for each ad combining the volatility and 

20 the expected value of the ad placement revenue in a certain way. This rule is based on a 

2 1 dynamic programming approach. This approach yields the trufc optimal selection 

22 algorithm among all possible non-anticipating selection algorithms. The present 

11 



1 invention adapts the dynamic programming solution to obtain a strategy that can be 

2 updated in real-time. 

3 The basic modeling technique of the present invention is outlined below and 

4 illustrated in Figure 7. 

5 Basic Modeling 

6 There are L customers 700 for each of whom the present invention tracks the 



7 value of MA customer attributes 702. Customer attributes 702 may be time-based, 

8 geography based, or any other segmentable and tractable attribute. There are N different 
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ads in campaign 704. 
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The present invention maintains a customer matrix: 


11 


Customer ID Attribute 1 Attribute 2 


Attribute MA 


12 


ID_1 


A_ll A_12 


A_1MA 


13 


ID_2 


A_21 A_22 


A_2MA 
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IDJL 


A_L1 A_L2 


ALMA 
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And an ad matrix: 
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Ad ID 


Attribute 1 weight ... 


Attribute MA weight 
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Ad_l 


W_ll 


W_1MA 


19 


Ad_2 


W_21 


W_2MA 


20 








21 


Ad_N \ 


WjNl 


W_NMA 


22 
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1 Approach 1 

2 1 . The estimated probability of customer x clicking on ad / is given by 



3 Z^-^X^-*)- 

4 2. Every time a customer visits a Web site within the network, the data is collected 712 

5 and the attributes of that customer are updated 714. 

6 3. Every time a customer is shown an ad, the attribute weightings for that ad are updated 

7 716 depending on how the customer responded. 

8 The calculation of which ad to show 710 is then clearly quick to compute as it is 

9 essentially (MA)(N) multiplications and additions and then a comparison of the 

1 0 determined probabilities 708. With some careful thought, the updates of the customer 

1 1 and ad matrices can also be done rapidly and with numerical stability. 

12 As the present invention collects more data, this method continues to refine the 



1 3 estimates and thus is referred to as Bayesian. Ads may lose their effectiveness over time, 

14 and people's attributes will certainly evolve over time. To capture this there are several 

1 5 updating methods that weight recent data more heavily. All of these methods can be 

16 updated quickly and require little storage. 

17 In use, as shown in figures 2 and 3, a customer accesses a participating Web site 

1 8 at illustrated 201, 301, an ad server determines the best ad to place (highest score of 1 50) 
.19 at 202, 302, the ad is served to the Web site at 203, 303 and a click by the customer 

20 directes him to the advertisers Web site at 204, 304. 

2 1 Adding Uncertainty and Optimizing for Earning vs. Learning 

22 Intuitively, there is a big difference between an ad that has been shown 1 00 times 
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1 and been selected once and an ad that has been shown 10,000 times and been selected 100 

2 times, even though each has been selected 1% of the times it has been shown. It is 

3 somehow worth something to us to learn more about the first ad, as it is quite possible 

4 that it will turn out to be a very popular ad. 

5 The present invention alters the above structure by carrying not just the mean but 

6 the standard deviation of each estimated random variable as well. 

7 The ad selection process then works by combining the estimated probability and 

8 the standard deviation in a certain way for each ad and then comparing. When done 

9 properly, this is the optimal way to balance earning and learning. 

1 0 Updates of the standard deviation can be calculated quickly as they can be based 

1 1 on the updates of the estimated probabilities. 

12 Adding Structure to the Matrices 

1 3 The present invention is also able to learn more about a given customer from other 

14 customers than the above is yet capturing. As a simple example, imagine that one has 

1 5 discovered that a particular ad is very popular with males and this system is considering 

16 showing it to a particular customer. The present invention has an attribute for gender, but 

1 7 doesn't yet know if this particular customer is male or female. However, there is lots of 



1 8 other data about the customer, such as interest level in sports. By looking at the attributes 

19 of all other customers, and the associated correlations, the present invention can estimate 

20 the probability that this customer is male. The present invention may find, for instance, 

2 1 that interest in sports is highly indicative of being male. 

22 Choosing the Attributes 

23 A key aspect of the present invention is identifying attributes that are predictive of 

14 
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1 behavior. This step requires analyzing real data, and should be re- visited periodically. 

2 Second, for numerical stability, the present invention must choose attributes that are not 

3 too similar to one another. There are several ways to choose a representative attribute set, 

4 basically by selecting orthogonal attributes. Third, the present invention needs concrete 

5 policies for deleting non-helpful attributes and splitting ones that are particularly useful. 

6 Finally, there are several statistical/data-analysis methods the present invention can 

7 employ to create updating procedures for the values of each attribute. The right 

8 procedure will depend on initial statistical tests and is also a step that should be re-visited 

9 at a later stage. 

10 As customers have long-term interests as well as short-term demands the present 

1 1 invention divides attributes into a long-term and a short-term attribute sets. The long- 

12 term attribute set measures how much time customers spend in different interest 

13 categories such as business, sports, and health. Thus, suppose that the customer chooses 

1 4 sports half the time and finance half the time. Then sports and finance attributes are each 

1 5 50% and the remaining attributes are 0%. 

1 6 The short-term attributes detect when a customer is searching for specific 

17 products. For example, a customer shopping for a new computer will likely visit sites 

1 8 that relate to computer sales. Such sites can be marked and computer ads placed on such 

1 9 sites have high probabilities of being selected, while general interest ads have markedly 

20 lower probability of being selected. 

2 1 Searching among the short-term attributes, for ads to show, will be quick as they 

22 only flag high probability events. 
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1 Advanced Modeling with Integrated Optimization and Scheduling 

2 Every Web site used with the present invention sends a request for an ad every 

3 time a user accesses the site. The request is sent to the ad manager. The ad manager has 

4 a lookup table specifying ads and associated probabilities defining the ads that should be 

5 shown next for every site. This lookup table is updated frequently, such as every hour or 

6 on any other relevant time unit basis. 

7 The system records that the ad has been shown and whether or not there was a 

8 click. The system holds a database with the number of impressions and clicks for each ad 

9 on each site by hour. The system also maintains a list of the total and remaining paid 

1 0 clicks for each ad, and a list of payments per click for each ad. 

1 1 Basics 

12 The goal of the optimizer-scheduler is to place ads on Web sites in such a way as 

1 3 to maximize the overall value for the advertising serving entity. This value may be a 

14 combination of impression, clicks, conversions, and other value that may be obtained by 

1 5 placing an ad on a particular site. The probability of a given ad being clicked on varies 

16 from site to site. The present invention does not know these probabilities beforehand but, 

1 7 rather, the present invention continuously refines this estimate as more observations are 

1 8 made. There is value in obtaining additional information about these probabilities and 

1 9 this is accounted for in the algorithm. 

* 20 Arrangements with Web sites tend to be fairly long-term. Arrangements with 

21 advertisers tend to be composed of campaigns, each lasting from days to weeks. The 

f * 

22 advertisers typically purchase a certain number of clicks. While not always spelled out 

23 explicitly, the understanding is that these clicks will occur reasonably uniformly over the 
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1 campaign's lifetime. Of course, there is no way to guarantee that an ad does not fall 

2 behind schedule (it is possible that nobody chooses to click on the ad). The present 

3 invention can, however, ensure (assuming that there is a reasonably rich set of ads) that 

4 no ad gets significantly ahead of schedule. This is captured via a tunable parameter 

5 within the algorithm. 

6 Occasionally, the arrangement with the advertiser is simply to show the ad a 

7 specified number of times. The system of the present invention serves the requested ad 

8 according to attributes described above while simultaneously tracking the number of 

9 times the ad is displayed. 

: 3 10 While taking the full lifetime of each campaign into account, the algorithm 

It 11 explicitly plans for the next 24 hours or other such reasonable period, and then re- 

1 2 optimizes more frequently, such as every hour. 

13 Definitions 

J 14 System Variables 

1 5 m denotes the number of Web sites or any reasonable partition of the Web sites in the 

16 network. 

1 7 n denotes the number of ad campaigns or any reasonable collection of ads currently 

18 underway. 

1 9 K denotes the set of ads that are on a pay-per-click basis or any other similar measure of 

20 performance. 

2 1 M denotes the set of ads that are on a pay-per-view basis or any other reasonable measure 

22 of activity that is not performance related. 
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1 ^ denotes the estimated number of impressions for a first period, such as one 24-hour 

2 period or other reasonable period, at site j. 

3 ^ J denotes the average clicking probability at site j calculated over a second, longer 

4 period, such as the past 30 days or other such reasonable period. Only incorporating the 

5 observed probabilities for ads that have at least, for example, 500 impressions at that site, 

6 then one possible embodiment would be to set ^ J = 0.005 if site j is new. Else 

( f \ ) 

a. = max Average(/? f7 Jt0.001 

7 ^ r^soo j j n examp i e} the use 0 f 30 d ays? 500 impressions, 

8 and the tolerances of 0.005 and 0.001 are merely exemplary and are not meant as a 

9 limitation on the average clicking probability^ 7 . Other timelines and constants could 

1 0 also be used without departing from the scope of the invention. 

1 1 Campaign variables 
T 

12 1 denotes the total duration in days of ad campaign /. 

13 t{ denotes the time in days since the ad campaign of ad / began. 
c 

14 1 denotes the maximum total number of paid clicks for ad / over the duration of the ad 

15 campaign. 

16 ' denotes the maximum number of remaining paid clicks for ad /. 

17 ^' denotes the total minimum number of impressions required by ad i over the duration 

18 of its campaign. k 
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1 ; denotes the minimum number of remaining impressions required for ad L 1 is 

2 updated frequently, such as every hour on the hour. 

3 S{ denotes the payment per click, per view, per conversion, or per any other reasonable 

4 measure of activity or performance, depending on the arrangement for ad /. 

5 n ' J is 2 plus the number of impressions for ad / at site j over the last 30 days or other 

6 such reasonable period. If the ad has never been shown at site j then n ' J =2. (The present 

7 invention adds 2 to avoid problems associated with HlJ -0) 
k 

8 lJ is the number of clicks for ad / at site j over the duration of ad fs ad campaign. 

9 is the observed clicking probability of ad / at site j. If ad / has never been shown 

Kj ^ 2 

10 ( n ' J ) on sitey then PiJ ^.Otherwise, n *>J n ^ J . The second term here 

v ~~ 0 

11 is to ensure that the present invention never has lJ ~ 

12 5 t controls the smoothness of the campaign. This can depend on the smoothness type, 

13 how the campaign is doing in terms of delivery, and other factors. A typical value is 0.2. 

14 This controls how smoothly clicks must occur throughout the lifetime of a campaign. A 

1 5 value of 0.2 means that no campaign can ever be more than 20% ahead of absolutely 

16 smooth (measured daily) delivery. 

17 Parameters 

18 Set ^ = 1 .5 or any other reasonable number. This is the learning parameter, it controls 

1 9 how heavily the present invention emphasizes learning about ad-site combinations for 

20 which the present invention has little information. This will be tuned via simulation. 
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1 a *J denotes the fraction of times ad / should be shown on site j for the next period, such 

2 as per hour. 

3 Hourly or Frequent Events 

4 The system sends the number of impressions and the number of clicks for each ad 

5 at each site to the ad manager. 

yi h t 

6 The ad manager updates tJ , ' J ,and 

7 The ad manager calculates . 

8 Updating of c ' and 7 < 

9 These variables are used in the optimization/scheduling algorithm. First, consider 

10 ° l . The contract for most ads specifies the beginning and end of the ad campaign and the 

1 1 maximum number of paid clicks. The scheduling algorithm requires a number that is to 

1 2 be used for one day. 

1 3 In the formula below, the present invention computes the value of ' that 

14 corresponds to a perfectly smooth delivery of clicks from the current time on. Note that 

15 in the linear program (LP), the present invention will not require that this be hit exactly, 

1 6 but rather within a pre-set tolerance. 



max 
c, = — 



max 



(( m \ \ 
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1 8 Now, consider II . Sometimes, it is agreed that ad / must obtain a minimum number of 

19 impressions. This minimum number must be satisfied at the end of the campaign. As 
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1 above, the formula above determines the number of impressions needed during the next 

2 day to achieve a smooth delivery of, in this case, impressions. 
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r 

max 



/.=■ 



^ max( 

4 Note that the present invention needs the term 2 * m to compensate for the fact the present 

5 invention has adjusted n,J . 
6 

7 Scheduling problem (solved frequently, such as once every hour on the hour) 

8 Step 1. Define: 



10 

1 1 Step 2. Solve the following linear programming problem: 



m 



1 3 Subject to £ ^ 0 + )c, , / 6 K (2) 

14 2X^*0 + »"eM (3) 

7=1 

15 IX,^ 1 * 7 = l,2,...,/w (4) 

(=1 

16 / = l,2,...,w, y =1,2 iw (5) 

17 

1 8 where v = 5, if ad / is click-based or conversion-based, and s, if it is impression- 

19 based. 

i* t 

20 Comments 
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1 (1) The objective function is to maximize the overall value, including learning about sites 

2 where we have little information. 

3 (2) The LHS is the total number of expected clicks for ad i during the interval This 

4 constraint enforces the campaign smoothness condition. 

5 (3) The LHS is the total number of expected impressions for ad / during the interval 

6 This constraint enforces the campaign smoothness condition. 

7 (4) This constraint ensures that the probabilities of what ads to show at each site add to 

8 100%. 

9 (5) This constraint ensures that all probabilities are non-negative. 

10 Remarks 

11 (1) By setting s > = 1 for all ' converts the objective function into one that seeks to 

12 maximize the overall Click-Thru-Rate (CTR). 

1 3 (2) There is no explicit constraint ensuring that each ad does not fall "too far behind". 

14 The reason for this is such a constraint would lead to the linear program (LP) having 

1 5 no feasible solution. 

16 (3) To account for the remark above, campaigns should be monitored on a frequent basis 

1 7 (daily) with poor ads being removed or outsourced. 

1 8 (4) Note that there is obviously always a solution to the LP. 

19 Creating an Ad lookup table 

20 The present invention describes the process of converting the output of the linear 

21 • program (LP) into a lookup table. For each site j and ad / multiply the '-■> by 100 and 

22 round off the product to the nearest integer. Let ^ = Round ( 100 * a >.J ). represents 
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1 how many times out of a hundred ad / should be shown at site j. Create a list for site/ by 

2 letting the first ] elements be ad 1, let the next j be ad 2, and so forth. 

3 This process will yield a list of approximately 100 ads for each site (many ads will appear 

4 several times for a given Web site). The next step is to ensure that the list has exactly 

5 1 00 ads for each site. This is done by truncating the list for any site with more than 1 00, 

6 and repeating the first ad on the list as many times as necessary for any site with less than 

7 100. 

8 It is possible to employ a frequency-capping component at this stage of the algorithm. 

9 Daily routine 

10 Calculate dj and ** J over the last 30 days or other such reasonable period, as 

1 1 shown in the schematic diagram of Figure 4. When new sites or new ads 410 are added, 

12 constraints are prepared 420, and the new matrices are added to the ad server's 

13 optimization engine 430. Prior to having adequate data, initial estimates (alphas) 435 are 

14 used and the data is added to the ad look-up tables 440. The ads are then served at 450 

1 5 (with testing 490 and frequency capping 492). Response data is collected at 460 and 

16 recorded together with the ad serving information in transaction log 470. The data is then 

1 7 used to update parameters at 480, and the iterative process continues. 

18 Enhancements 

1 9 This framework allows for a number of additional constraints to be added in a 

20 natural way. 
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1 Click probability estimation with principal components 

2 Above, the probability that users visiting Web site / will click on ad i was 

3 estimated by dividing the number of clicks on ad / at Web site j with the number of 

4 impressions of ad i at Web site j 9 but can be estimated by any other reasonable method. 

5 An alternative is a principal component approach to banner ad probability 

6 estimation. This approach contains two steps. In the first step we estimate the principal 

7 component vectors whereas in the second step we estimate the banner ads' click 

8 probabilities. Each step are updated as new information becomes available. 

9 The advantage to using the principal component approach is significant. For example, if 



10 there are 100 Web sites and 5 principal components then the conventional approach 

1 1 requires approximately 20 times as many impressions as the principal component 

12 approach to reach the same level of accuracy. 

13 This approach is begun by presenting a series of definitions. It continues by 

14 describing the principal component estimation, and concludes by finally describing the 

1 5 probability estimation, 

16 Definitions 

1 7 Probabilities Estimate of the probability that users downloading ad / from Web site j 



1 8 will click on that ad is p . 

19 Error Uncertainty of the estimate p t J is a t J = p * (l - p tJ )/« , (a slightly 

20 biased estimate), 

2 1 Sites There are m sites. 



22 Site Average Let // y denote the average click probability on site /. 
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1 Normalized Ad probability Vector - For each ad i we define the vector 

2 y, =[y^y^-^y^\ where y =— ^ . 

3 Principal Components - hypothesize that there exist / m-dimensional vectors 

4 x ]9 x 29 ... 9 x j9 such that every ad probability vector is a linear combination of x { , x 2 , . . . , x l . 

5 0f/zer Let n, ^ denote the number of impressions of ad / on Web site j and let k l } 

6 denote the number of clicks of ad / on Web site j. 

7 Principal components estimation 

8 When using principal components estimation, the present invention identifies ads 

9 that have been shown a large number of times at many Web sites. These are the ads that 

10 will be used to calculate the principal components. 

1 1 Step 1 . Calculate estimation of site averages. 

12 M f = ~i \ 

Count(i on jj 

1 3 Step 2. Calculate the variance of the error of each probability estimate. 

14 cr itJ ^ /( /(1-aJ/« 

15 Step 3. Calculate normalized ad probability vectors. 

16 Step 4. Calculate the principal components by first creating the matrix Y. Row/ of Y 

1 7 corresponds to ad i. Then calculate the matrix product Y J Y . Then find the eigenvectors 

1 8 and eigenvalues of Y r Y . Choose the k eigenvectors corresponding to the k eigenvalues 

19 which together accounts for at least x% of the total of the sum of all eigenvalues. The * 

20 first principal component corresponds to the first eigenvector as follows: Element i of the 

25 



1 eigenvector is the weight associated with ad /. Therefore, multiply the elements of the 

2 first eigenvector with their corresponding estimated probabilities for each site and sum 

3 over these newly found values to determine the first principal component vector. Repeat 

4 the procedure for the remaining k-1 eigenvectors. 

5 Banner ad click probability estimation 

6 With the principal components available there are a variety of ways to estimate an 

7 ad's click probabilities. Two straightforward methods of such estimation are ordinary 

8 least squares regression and generalized least squares regression. 

9 The objective of the principal component approach is to efficiently and quickly 

1 0 obtain ad probabilities for a majority of banners. In addition to finding the probabilities 

1 1 for the majority it is also necessary to identify banners where the principal components do 

12 not capture a significant portion of the observed probabilities. A maximum likelihood 

1 3 approach can be used to integrate this aspect into the probability estimation routine. 

1 4 Binomial Updating of Click Probabilities Using Principal Components 

1 5 Consider a row of n cells that have unknown click probabilities p g , where cells 

16 are / = l,2,...,n 

1 7 Assume there is a single (for notational simplicity) principal component that is 

1 8 likely to give these probabilities. This principal component is a vector 

19 v = (v 1? v 2 ,...,vj>0. Then model the vector P as 

20 P = av + e 

2 1 where a is an unknown constant and e = (e x >e 2 , . . . , e n ) is a vector of errors. 
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1 



Then assume that the e/sare independent, normal random variables with zero 



2 mean and variance a 2 . The variance is determined by the process that determines the 

3 principal components. 

4 Now, imagine the system has been run for a while and has observed k l clicks from 

5 n l impressions in cell /. It is then desirable to assign the best p t 's. 

6 The joint probability of those click rates and the probabilities given a is 



P = f|exp 



1=1 



-1 
2<r 2 



8 where C is a constant independent of a and the p l 's. 

9 Now determine a and the p x y s by maximizing P with respect to a and the p g ' s . 

1 0 Ignoring C ? to obtain: 

11 i nj p = -±|](^ - av ,) 2 + („, -A,)ln(l- A )] (*) 

^cr /=i ,=i 

12 Note that In P is concave with respect to a and p's > 0, so maximization is well-defined. 



1 3 Note that (as one would expect) if a » 0 and/or n, , k, large, one finds p,=—. Also, for 



14 c small and/or n t , k l small, one finds p t = #v ( . 
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Now, the problem is separable with respect top, ' s , so one strategy is to maximize 



1 6 with respect to p, with a fixed. This gives the necessary condition: 



17 
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•1 



K («,-*,) _, 



F(p l )-- r (p J -av,) + ^— 
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1 Note that F(0) = +00 and that F(l) = -00 . Hence, there is a p i with 0 < p, < 1 and 

2 F( Pl ) = 0. 

3 Furthermore, 

5 so F is monotone. Thus, the solution is unique. 

6 It can therefore be concluded that for a given a , there is for each / = 1,2, . . . , n a 

7 unique />, , 0 < /?, < 1, that can be easily found by Newton's method or any other descent 

8 method. (The case of k t = 0 is handled separately later.) 

9 Now, consider p t to be a function of a . Then, 

da da ~{ dp, 
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dlnP 



da 

-V2>, (a) -"v>, 



cr 

1 1 This discussion motivates the following algorithm: 

12 1. Select initial a 

13 2. Find the p,'s by solving F t (p, ,a) = 0 (Newton's method 1 variable at a time) 

14 3. Evaluate — InP 

da 

15 4. Adjust a by steepest descent 

1 6 Note that the extension to multiple principal components is straightforward. 

17 Case oik, = 0 
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1 The necessary condition is 

2 (l-A)(^,-^) = ^ 2 

3 It is easy to see that if av t > 2 , then there is a solution with 0 < p t < 1 . Otherwise 

4 A = 0. should be used. Putting this together, 

5 p t - max{root l ,0} where root { is the root of the quadratic less than 1 . That is, 



root { : 



1 + ov, - J(l + av, ) 2 - 4(av, - n, a 2 ) 



7 Note that it follows from this that if n { = 0, we have p t = av, . If £, = 0 repeatedly, one 

av 

8 does not set p x = 0 until they get at least = — y impressions. 

9 Initial value of a 

1 0 If all the n t ' s are small, and/or <r 2 is small, we set p t = av, for all /. 

11 Then, 

12 LnP = £ In ov, + J (w, - *, ) ln(l - m>, ) 

13 dlnP = f k > f ( n .- k >\ =0 

3a tl* « Zf* 



14 Solve for a. 

15 This can be interpreted by multiplying by a. 
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1 which shows that a is set to balance the overall probabilities consistent with observed 

2 clicks and impressions. 

3 Prior distribution on a 

4 Adding a prior density on a as 

5 -^=L-exp{--^y(a-a 0 ) 2 } 

6 This adds the term 

8 to InP as defined in (*) above. 

9 Category restrictions 

10 Certain advertisers would like to have their ads displayed only on a subset of the 

1 1 sites. This is handled in the following way. Let the subset of such sites be denoted by 7. 

12 This might be, for example, the set of all sports related sites. Then, if the present 

1 3 invention is considering ad /, the restriction takes the form: 

14 ^^forall^- 7 - 

1 5 The subset J can, of course, involve multiple levels of categories, generally 

1 6 chosen by the advertiser. A typical subset could be something like 'all of the sports 

1 7 related - Spanish language - G-rated sites. ' 

18 Ad Blocking 

1 9 Conversely, certain Web sites would like to prevent particular ads from appearing 

20 on their site. This may be the case, for instance, if the item being advertised is viewed as 
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1 a competitor to the Web site's product. Let the site be denoted by j and the set of ads to 

2 be blocked to be denoted by the set / . Then the restriction has the form 

3 a, j =0forall iel. 

4 Typically, a Web site would be able to do this by both blocking entire categories, 

5 such as R-rated sites, and by selecting particular ads for exclusion, such as one of a direct 

6 competitor. 

7 Click-Thru-Rate (CTR) of impression based ads 

8 Even with contracts that are strictly impression based, it may be advantageous to 

9 attempt to enhance the CTR of such ads. Providing a good CTR may lead to more future 

1 0 business. To do this, the present invention must determine how valuable each click on an 

1 1 impression based ad is in economic terms. Then, this can simply be added to the 

12 objective function. 

13 Clustering process 

14 Automatic clustering of small Web sites can be employed in a manner that 

1 5 effectively improves overall Click-Thru-Rates. To form clusters, the process starts by 

1 6 matching each ad with a campaign type, which is assigned through a GUI. There are types 

1 7 for 'Personal Finance', ' Sports', 'Computers and Technology', and the like. The present 

18 invention denotes each campaign type t„i = 1,2,...,20 , and the set of all campaign types 

19 T . Each cluster will correspond to one of these types. 

20 To determine which types will be used for clustering, a database is used with the 

21 history of the last 30 days or other reasonable period, and count all the impressions for 

22 each type. If the objective is to form « clusters, then the first n types ordered by 
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1 descending number of impressions are selected to be the clustering types. Now call each 

2 clustering type / ,j = 1,2,..., n , and the set of all the clustering types T . Each clustering 

3 type is assigned a number (ID) starting from 2 and going up until n+L A Webmaster with 

4 cluster ID = 0 means that it was not clustered, and with ID = 1 means it is in a cluster of 

5 special Webmasters. 

6 The database contains information on all the campaign types that each Webmaster 

7 showed. Not all webmasters-type pairs in the database will be used to perform the 

8 computations; in one embodiment, only those that meet the following requirements: 

9 • It must have more than 2 impressions on a type 

10 • It must have more than 1 click on a type 

1 1 • The CTR for a type must be less than 1 00% 

1 2 Although this is a preferred screening process, any other such reasonable screening 

13 process can be used without departing from the scope of the present invention. 

1 4 In addition, the set of campaign types for a Webmaster must be a superset of the 

1 5 clustering types: fcT,, where m represents a particular Webmaster. 

1 6 Each Webmaster will be assigned to one and only one cluster, so it will have a 

1 7 corresponding cluster ID, ID m . Only one more piece of information is needed to 

1 8 determine the cluster ID of each Webmaster: p-hat. 

era,, (l- era, j ^ 

20 where yis a learning parameter m is the Webmaster, / is the campaign type, and imps m j 

2 1 refers to the number of impressions for the Webmaster-campaign type pair. Now, 
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P-^t m j-CTR aj+ y 



1 ID m =\ + ztgmw\p_hat m * = 1,2,...,*. 

2 Each j corresponds to a clustering type, as defined before. 

3 Thus, the object is to look for the max p-hat for each Webmaster. The type 

4 associated with the max p-hat will be cluster assigned to the Webmaster. In order to write 

5 the output, the present invention translates the type to its cluster ID. 

6 Splitting large clusters 

7 It could be the case that once clusters are formed, the total number of impressions 

8 for one of them will be over 20% or any other reasonable set percentage of the total 

9 number of impressions for all the clusters. In this case, it is desirable to split the cluster by 

10 applying the clustering process to those Webmasters in the largest cluster, and by forming 

1 1 a new set of two clustering types for them that excluded the type associated with the 

12 cluster. For instance, if cluster 3 with associated type 'Sports' is the target, then a new 

13 clustering type set might be {'Entertainment', 'Health'}, which will be chosen because 

14 they are the two types with the most and second-most impressions. Each Webmaster will 

15 be assigned a new cluster ID using the same "max p-hat" criteria. 

1 6 The splitting process is repeated until no cluster has more than 20% of all the 

17 impressions. 

1 8 Integrated Channel Management 

19 It is also desirable to optimize ad placement across a diverse set of media, such as 

20 banners, e-mail, and wireless, in an integrated manner. An allocator 500, as shown in 

21 Figure 5, can be used to serve full-sized 510, od4-sized # 520, and other type 530 ads using 

22 the following algorithm: 
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1 Definitions 

2 V t - Expected impressions per period, such as per day, of media type /. 

3 p = probability of a click on media type / for campaign;. 

4 Gj = Total target number of clicks for campaign j for the period. 

5 g = The percent of all impressions from media i that will be allocated to campaign/. 

6 Max %p y g 9 K 

1 s.L Z^y- 1 forall/ 

j 

t 8 Y, PlJ g lJ V l <{\^5)G J for ally 

:3 9 g tJ > 0 for all / and j 

; 1 1 0 Of course, constraints enforcing minimum and maximum representation on 

3 11 various channels are possible as well. 

;3 12 Then, p g tJ V t is sent to the LP as the upper bound for campaign j for channel type 

14 Multiple ads from one customer 

15 From time to time, an advertiser will employ multiple banner designs. One 

16 approach to this, of course, is simply to treat each of these as a separate ad. However, if 

1 7 the advertiser is willing to let the optimizer select which ads to show, the present 

1 8 invention can expect on average an improvement in the CTR. Imagine that the two ads 

1 9 are labeled / and m, and that the initial click totals (on an average daily basis) were ; and 

20 ° m . Then, normally the present invention would have included the two constraints: 
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m 

1 

m 

2 7=1 

3 Instead, the present invention can replace this with the single constraint, which is 

4 less restrictive and therefore will result in a better or equal solution: 

m 

5 J* 

6 It is also possible to do something in between the above two solutions. For example, 

7 an advertiser with two different ad designs could ask for a total of 10,000 clicks with a 

8 minimum of 2,500 each. Therefore, there are many other reasonable solutions. 

9 The method of the present invention can be practiced by conventional servers 620, 

10 630, such as Pentium III based systems operating with Windows NT, interacting over the 

1 1 Internet 600 to collect attribute information about customers 640 and ads from database 

12 610, and then serve the ads to the customers 640 operating Internet enabled devices with 

13 browsers, such as Apple Macintosh or Windows-based personal computers with browser 

14 clients like Internet Explorer or Netscape Navigator, as shown in figure 6. As such, there 



15 are no special requirements for the user interaction on the Internet using the present 

1 6 invention. Conventional PCs, which may be Pentium based or Apple Macintosh type 

1 7 processors, are all suitable processors for exercising the present invention. Likewise, the 

1 8 server of the present invention can be an Intel Pentium type server, Sun server or other 

19 server suitable for serving advertisements. 

20 Numerous aspects of the present invention also have separate utility outside of any 

21 Internet enabled distribution channels. The basic modeling methodologies and algorithms 
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1 of the present invention are therefore able to be incorporated with virtually any other 

2 marketing medium in which an "ad" is displayed to a "customer," including, but not 

3 limited to, mail, telephone, facsimile, television, radio, and print media. Other 

4 embodiments, with modifications and changes to the preferred embodiment, will be 

5 apparent to those skilled in the art without departing from the scope of the present 

6 invention as disclosed. Therefore, the present invention is only limited by the claims 

7 appended hereto. 
8 



1 We Claim: 

2 L A method for optimizing Internet ad placement, comprising: 

3 tracking L customers on the Internet for placement of ads to said customers; 

4 selecting MA attributes to track for each customer to form a customer matrix 

5 A_LMA of L customers and MA attributes; 

6 providing N ads to serve to said customers; 

7 forming an ad matrix of N ads and weights WJfMA for each of said MA 

8 attributes; 

9 estimating the probability of customer x clicking on ad /; and 
10 serving the ad / to customer x that has the highest probability. 
11 

12 
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1 ABSTRACT 

2 This invention concerns optimal ad selection for Web pages by selecting and 

3 updating an attribute set, obtaining and updating an ad-attribute profile, and optimally 

4 choosing the next ad. The present invention associates a set of attributes with each 

5 customer. The attributes reflect the customers 5 interests and they incorporate the 

6 characteristics that impact ad selection. Similarly, the present invention associates with 

7 each ad an ad-attribute profile in order to calculate a customer's estimated ad selection 

8 probability and measure the uncertainty in that estimate. An ad selection algorithm 

9 optimally selects which ad to show based on the click probability estimates and the 
1 0 uncertainties regarding these estimates. 
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I believe I am the original, joint and first inventor of the subject matter which is claimed and for which 
a patent is sought on the invention entitled OPTIMAL INTERNET AD PLACEMENT, the 
specification of which is attached hereto. 

I hereby state that I have reviewed and understand the contents of the above identified specification, 
including the claims, as amended by any amendment referred to above. 

I hereby claim the benefit under U.S.C. §1 19(e) of the United States provisional application no. 
60/164,253, filed November 8, 1999. 

I acknowledge the duty to disclose information which is material to the examination of this 
application in accordance with Title 37, Code of Federal Regulations, § 1.56(a). 

I hereby appoint the following attorney(s) to prosecute this application and to transact all business 
in the Patent and Trademark Office connected therewith: 

Jon L. Roberts 
Registration No. 31,293 
John K. Abokhair, Esq. 
Registration No. 30,537 
Kevin L. Pontius, Registration No. 37,512 
Christopher B. Kilner, Registration No. 45,381 
Roberts Abokhair & Mardula, L.L.C. 
t 1 1 800 Sunrise Valley Drive 

Suite 1000 
Reston, Virginia 20191-5302 
(703)391-2900 



I declare that all statements made herein of my own knowledge are true and that all statements made 
on information and belief are believed to be true; and further that these statements are made with the 
knowledge that willful false statements and the like so made are punishable by fine or imprisonment, 
or both, under Section 1001 of Title 18 of the United States Code and that such willful false 
statements may jeopardize the validity of the application or any patent issued thereon. 

Full name of inventor John B. Ferber 

Inventor's Signature Date 



Residence Baltimore. Maryland 
Post Office Address: 



Citizenship: US 



Full name of inventor Scott Ferber 



Inventor's Signature Date 

Residence Baltimore. Maryland 

Post Office Address: 



Citizenship: US 



